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P21595.Claims 

1, An image interpolating device comprising: 

a color filter having a first row, in which red (R) and green (G) color 

filter elements are alternately aligned in the horizontal direction, and a 
5 second row, in which G and blue (B) color filter elements are alternately 

aligned in the horizontal direction, said second row being adjacent to the 

upper or lower side of said first row; 

an imaging device that generates first R, G, and B-signals which are 

pixel signals corresponding to said color filter elements; 
10 a pattern-setting processor that extracts images belonging to a first 

pattern, in which a pixel having said first R-signal is positioned at the 

upper-left corner of a 2 x 2 pixel matrix, a second pattern, in which a pixel 

having said first G-signal is positioned at the upper-right corner of said 2 x 

2 pixel matrix, a third pattern, in which a pixel having said first G-signal is 
15 positioned at the lower-left corner of said 2x2 pixel matrix, and a fourth 

pattern, in which a pixel having said first B-signal is positioned at the 

lower-right corner of said 2x2 pixel matrix, from said first R, G, and B- 

slgnals generated by said imaging device; 

a G-interpolation processor that, regarding first and fourth objective 
20 pixels contained in said images belonging to said first and fourth patterns, 

obtains a second G-signal by utilizing said first G-signals of pixels adjacent 

to said first or fourth objective pixel; 

an R/B-interpolation processor that, regarding second and third 
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objective pixels contained in said images belonging to said second and 

third patterns, obtains second R and B-signals by utilizing said first R and 

B-signals of pixels adjacent to said second and third objective pixels; 

a B-interpolation processor that extracts a first similar pixel which 

5 has the closest luminance value to that of said first objective pixel, from 

pixels adjacent to said first objective pixel, and obtains a third B-signal 

based on first information of said first similar pixel; and 

an R-interpolation processor that extracts a second similar pixel 

which has the closest luminance value to that of said fourth objective pixel, 

10 from pixels adjacent to said fourth objective pixel, and obtains a third R- 

signal based on second information of said second similar pixel. 

2. A device according to claim 1, wherein said first information 

comprises a luminance value and a color difference signal Cb of said first 

similar pixel, and said second information comprises a luminance value 

15 and a color difference signal Cr of said second similar pixel. 

3^*^ device according to claim 1, wherein said first information 
K 

comprises color difference signals Cb and Cr, and said second information 
comprises color difference signals Cb and Cr, 

^device according to claim 1, wherein said pixels, which are 

A 

20 adjacent to said first and fourth objective pixels and which are utilized in 
said G-interpolation processor, are contained in said images belonging to 
said second and third patterns. 
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5. A device according to claim 1, wherein said pixels, which are 
^ 

adjacent to said second and third objective pixels and which are utilized in 
said R/B-interpolation processor, are contained in said images belonging to 
said first and fourth patterns. 

5 6. A device according to claim 1, wherein said pixels, which are 

A 

adjacent to said first and fourth objective pixels and which are utilized in 
both said B-interpolation processor and said R-interpolation processor, are 
contained in said images belonging to said second and third patterns. 

7. A device according to claim 1, wherein said B-interpolation 
1 0 processor and said R-interpolation processor respectively extract said first 

and second similar pixels, using said first G-signals of said pixels adjacent 
to said first and fourth objective pixels. 

8. A device according to claim 2, wherein said B-interpolation 
h 

processor obtains said third B-signal, on the assumption that said color 
15 difference signal Cb of said first objective pixel is equal to said color 
difference signal Cb of said first similar pixel. 

9. A device, according to claim 2, wherein said R-interpolation 
processor obtains said third R-slgnal, on the assumption that said color 
difference signal Cr of said fourth objective pixel is equal to said color 

20 difference signal Cr of said second similar pixel. 

10. A device according to claim 2, wherein said B-interpolation 

k 

processor obtains said third B-signal, using said color difference signal Cb 
and a modified luminance value which is obtained by multiplying said 
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luminance value by a ratio of said second G-signal of said first objective 
pixel and said first G-signal of said first similar pixel. 

11. A device according to claim 10, wherein said B-interpolation 

A 

processor obtains said third B-signal, according to the following formula. 
5 Y=0.299 x R(x'y)+0.587 x O(x l l y7+0.114 x B(x'.y') 
Cb=-0.169 x Rlx'.y-MUSI x G{x'Y)+u.5 x B<x\y') 
YG=Y x G(x,y)/G(x',y') 
b=YG+1.772xCb 

wherein Y is a luminance value of said first similar pixel, R(x\y'), G(x\y'), 
10 and B(x\y') are said second R, first G, and second B-signals of said first 
similar pixel, G(x.y) is said second G-signal of said first objective pixel, b is 
said third B-signal obtained by said B-interpolation processor, and YG is 
said modified luminance value. 

12. A device according to claim 2, wherein said R-interpolation 

A. 

15 processor obtains said third R-signal, using said color difference signal Cr 
and a modified luminance value which is obtained by multiplying said 
luminance value by a ratio of said second G-signal of said fourth objective 
pixel and said first G-signal of said second similar pixel. 

13. a device according to claim 12, wherein said R-interpolation 
20 processor obtains said third R-signal, according to the following formula. 

Y*0.299 X R(x\y)+0.W7 x G(x'y)+0.114 x B(x',y) 
Cr*0.5 x R(x'y)-0.41 9 x G^ 1 ,y>0.081 x Btx'.y') 
YG=YxG(x,y)/G(x',y') 
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P2l595.Claims 
r*YG+1.402xCr 

wherein Y is a luminance value of said second similar pixel, Rfx'.y'), 

G(x',y'), and B(x\y') are said second R, first G, and second B-signals of said 

second similar pixel, G(x,y) is said second G-signal of said fourth objective 

5 pixel, r Is said third R-signal obtained by said R-interpolation processor, 

and YG is said modified luminance value. 

Centner" 1 * *** s *>i>9ii) 
14. A device according to claim 1, wherein said B-interpolation 

A 

processor extracts said first similar pixel, using said first G-signal and said 
second R-signal of said pixels adjacent to said first objective pixel. 

10 15. A device according to claim 1, wherein said R-interpolation 

\ 

processor extracts said second similar pixel, using said first G-signal and 
said second B-signal of said pixels adjacent to said fourth objective pixel. 

16. A device according to claim 2, wherein said B-interpolation 

k 

processor obtains said third B-signal, using said color difference signal Cb 
15 and a modified luminance value which is obtained by multiplying said 

luminance value by a ratio of a first reference value, which is obtained 

based on said second G-signal and said first R-signal of said first objective 

pixel, and a second reference value, which is obtained based on said first 

G-signal and second R-signal of said first similar pixel. 
20 17. A device according to claim 16, wherein said B-interpolation 

processor obtains said third B-signal, according to the following formula. 

Y=0.299 X R(x\/)+0.587 x G(x',y')+0.114 X B(X\y') 

Cb»-0.169 x R(x\y')-0.331 x G(x',y)+0.5 x Bfx'Y) 
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YG=Y x 

(0.587 x G(x,y)+0.299 x R(x,y))/(0.587 x G(x\y')+0.299 x R(x\y*)) 
b=YG+1.772xCb 

wherein Y is a luminance value of said first similar pixel, R{x\y'), G(x',y'), 
5 and B(x',Y) are said second R, first G, and second B-signals of said first 
similar pixel, G(x,y) is said second G-signal of said first objective pixel, b is 
said third B-signal obtained by said B-interpolation processor, and YG is 
said modified luminance value. 

18. A device according to claim 2, wherein said R-interpolation 
10 processor obtains said third R-signal, using said color difference signal Cr 

and a modified luminance value which is obtained by multiplying said 
luminance value by a ratio of a first reference value, which is obtained 
based on said second G-signal and said first B-signai of said fourth 
objective pixel, and a second reference value, which is obtained based on 
15 said first G-signal and said second B-signal of said second similar pixel. 

19. A device according to claim 18, wherein said R-interpolatlon 
processor obtains said third R-signal, according to the following formula. 
Y=0.299 x R(x',y , )+0.587 x G(x , ,y , )+0.114 x B(x\/) 

Cr=0.S x R(x\y>0.419 x Gfx'.y'HJ.OSI x B(x\y*) 
20 YG=Yx 

(0.587 x G(x.y)+0.114 X B(x,y))/(0.587 x G(x\y)+0.114 x B(x\y')) 
r=YG+1.402xCr 

wherein Y is a luminance value of said second similar pixel, R(x , ,y'). 
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GJx 1 ,/), and B(x\y') are said second R, first G, and second B-signals of said 
second similar pixel, G(x,y) is said second G-signal of said fourth objective 
pixel, r is said third R-signal obtained by said R-interpolation processor, 
and YG is said modified luminance value. 

(Cx\ OSeUTtV AH^A)06J>) 

5 20 A device according to claim 3, wherein said B-interpolation 
processor obtains said third B-signal, on the assumption that said color 
difference signals Cb and Cr of said first objective pixel are equal to said 
color difference signals Cb and Cr of said first similar pixel. 
21. A device according to claim 3, wherein said R-interpolation 

10 processor obtains said third R-signal, on the assumption that said color 
difference signals Cb and Cr of said fourth objective pixel are equal to said 
color difference signals Cb and Cr of said second similar pixel. 

22 A device according to claim 3, wherein said B-interpolation 
K 

processor obtains said third B-signal, using said first R-signal of said first 
15 objective pixel and said color difference signals Cb and Cr of said first 
similar pixel. , 

23 A device, according to claim 22, wherein said B-interpolation 
processor obtains said third B-«ignal, according to the following formula. 
Cb=-0.169 x R(x',y')-0.331 x Gjx'YJ+O.S x B(x , ,y') 

20 Cr=0.5 X R(x'Y)-0.419 X G(x\y")-0.081 x Btx'.y') 
b=1.293 X R(x,y)+2.293 x Cb-1.812 X Cr 

wherein Rfr'Y). G(x\y'), and B(x',y") are said second R, first G, and second 
B-signals of said first similar pixel, R(x,y) is said first R-signal of said first 
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objective pixel, and b is said third B-signal obtained by said B-interpolation 
processor. aP ,\ 

^warily A Mf 

24. A device according to claim 3, wherein said R-interpolation 

K 

processor . obtains said third R-signal, using said first B-signal of said 
5 fourth objective pixel and said color difference signals Cb and Cr of said 
second similar pixel. 

25. A device according to claim 24, wherein said R-interpolation 
processor obtains said third R-signal, according to the following formula. 
Cb=-0.169 x R(x a ,y')-0.331 x G{x\y')+Q.B x B(x , ,y") 

10 Cr=0.5 x R(x\y')-0.419 x G(x\y')-0.081 X B(x\y') 
r*0.773 X B(x,y)-1 .773 X Cb+1 .401 x Cr 

wherein R(x',y'), G(x\y'), and B(x\y') are said second R, first G, and second 
B-signals of said second similar pixel, B(x,y) is said first B-signal of said 
fourth objective pixel, r is said third R-signal obtained by said R- 
15 interpolation processor. 



PAGE 9/9 ' RCVD AT 1/5/2005 3:15:34 PM [Eastern Standard Time] 1 SVR:USPTO-EFXRF-2/2 * DNIS7466863 ' CSID: * DURATION (mnws):03-14 



Application/Control Number: 10/043,127 



Page 



Art Unit: 2615 

2. Any inquiry concerning this communication or earlier 
communications from the examiner should be directed to TUAN HO 
whose telephone number is (703) 305-4943. The examiner can 
normally be reached on Mon-Fri from 7AM to 4PM. 

If attempts to reach the examiner by telephone are 
unsuccessful, the examiner's acting supervisor, Thai Tran can be 
reached on (703) 305-4725. The fax phone number for the 
organization where this application or proceeding is assigned is 
(703) 872-9306 

Any inquiry of a general nature or relating to the status 
of this application or proceeding should be directed to the 
receptionist whose telephone number is (703) 305-4700. 




TUAN HO 



Primary Examiner 
Art Unit 2615 



